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(54) DEVICE AND METHOD FOR PROCESSING LANGUAGE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To deepen the degree of 
relation for a classified word as well and to improve the 
accuracy of chain probability by semantically classifying 
the word according to a thesaurus. 
SOLUTION: A processing block 3 divides the pair of 
input sentences into respective three parts and by 
exchanging these parts, a non-semantic sentence is 
generated. A morpheme analytic block 2 divides the pair 
of generated non- semantic sentences for the unit of a 
word. A storage block 4 stores the thesaurus. A word 
classifying block 6 converts a word to a class code 
based on the thesaurus. A storage block 8 stores the 
table of trigram probability between classes. A 
processing block 10 calculates Perplexity based on the 

class trigram concerning the set of all the generated non-semantic sentences and selects the 
set of non-semantic sentences having the highest Perplexity. Thus, the classification of the 
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thesaurus is stored and according to this classification of the thesaurus, the word is classified. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A language processor with which one class classifies two or more words into two or more classes which comprise a set of two or more words, 
acquires chain probability which shows a grade of a chain between the classified classes concerned in them, and chooses a class and/or a word 
sequence as them based on the acquired chain probability concerned, comprising: 
A memory measure which memorizes a classification of a thesaurus. 

A sorting means which classifies said two or more words according to a classification of this thesaurus. 

[Claim 2]A language processor when classifying said two or more words in the language processor according to claim 1 , wherein said sorting means 
changes a word into a classification code and calculates said word sequence with a gestalt of a classification code sequence at the time of calculation 
of said chain probability. 

[Claim 3]A language processor, wherein said sorting means makes this attached word itself a classification code about an attached word attached to 
said word in the language processor according to claim 2. 

[Claim 4]A language processor, wherein said sorting means classifies every part of speech in the language processor according to claim 2 in the case of 
an independent word with which said word is not indicated to a classification of said thesaurus. 

[Claim 5]A language processor having further a selecting means chosen as a meaningless sentence which uses a word sequence from which said chain 
probability serves as the minimum in an acoustic-sense experiment in the language processor according to claim 1. 

[Claim 6]A language processor having further a selecting means which chooses a word sequence from which said chain probability serves as the 
maximum as an optimal candidate in voice recognition candidates in the language processor according to claim 1. 

[Claim 7]In the language processor according to claim 1, it relates to calculation of chain probability between each word, A language processor 
characterized by presuming chain probability between said words based on appearing probability of said word, and chain probability between said 
classes when appearing probability of a word in a class and chain probability between classes are acquired and chain probability between words does 
not acquire directly. 

[Claim 8]One class classifies two or more words into two or more classes which comprise a set of two or more words. In a language processing method 
which acquires chain probability which shows a grade of a chain between the classified classes concerned, and chooses a class and/or a word 
sequence based on the acquired chain probability concerned, A language processing method memorizing a classification of a thesaurus and classifying 
said two or more words according to a classification of this thesaurus. 

[Claim 9]A language processing method changing a word into a classification code and calculating said word sequence with a gestalt of a classification 
code sequence in the language processing method according to claim 8 at the time of calculation of said chain probability when classifying said two or 
more words. 

[Claim 10]A language processing method making this attached word itself into a classification code about an attached word attached to said word in the 
language processing method according to claim 9. 

[Claim 1 1]A language processing method classifying every part of speech in the language processing method according to claim 9 in the case of an 
independent word with which said word is not indicated to a classification of said thesaurus. 

[Claim 12]A language processing method, wherein said chain probability chooses a word sequence used as the minimum in the language processing 
method according to claim 8 as a meaningless sentence used in an acoustic-sense experiment. 

[Claim 13]A language processing method, wherein said chain probability chooses a word sequence used as the maximum as an optimal candidate in 
voice recognition candidates in the language processing method according to claim 8. 

[Claim 14]In the language processing method according to claim 8, it relates to calculation of chain probability between each word, A language 
processing method characterized by presuming chain probability between said words based on appearing probability of said word, and chain probability 
between said classes when appearing probability of a word in a class and chain probability between classes are acquired and chain probability between 
words does not acquire directly. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]In natural language processing, this invention relates to the language processor and method of choosing / generating the optimal 
word sequence, and relates to the language processor and method using statistical information between the word classes especially set up based on 
the thesaurus. 
[0002] 

[Description of the Prior Art]Conventionally, the word n-gram model using the statistical chained information of n words was used in the language 
processor. The word was classified for every part of speech, the word class was created, and the class n-gram model using the statistics chained 
information between these word classes (between parts of speech) was also used (about the above, it is referring to north other "spoken language 
processing" Morikita Shuppan, for example). In these methods, when the number of words to treat increased for example, in the case of the word n- 
gram model and n became large, the problem called what is called a sparse problem it becomes impossible to fully presume the chain probability 
between words arose. On the other hand, in the case of the class n-gram model between parts of speech, there was a fault that only rough language 
processing could be performed. 
[0003] 

[Problem(s) to be Solved by the Invention]In an acoustic-sense mental experiment etc., although the experiment which judges whether a test subject 
can catch a sound exactly is conducted, there is a demand of liking to remove the influence of a semantic analogy and to investigate only the original 
auditory characteristic, in this case. There is a way the right creates grammatically the sentence along which a meaning does not pass as the method of 
satisfying such a purpose (for example, Kazuo Watabe: "effect to the advanced age hearing impairment person of the speech rate delay by rate of 
speech conversion", an Oto-Rhino-Laryngological Society of Japan.Inc. report, Vol.99, pp.445-453 (1996)). However, it was unable not to find the good 
method of creating the examination sentence along which a meaning does not pass, but to remove a maker's arbitrary element from the created 
examination sentence as a matter of fact. 

[0004]On the other hand, in speech recognition, in order to choose from the recognition result in a sound level linguistically the word sequence which 
will seemingly be reasonable in order to raise recognition performance, or to reduce the number of the candidates who can assume as a recognition 
result after it using the recognition result obtained till then, the word n-gram is used. In the large lexical continuous speech recognition, especially use 
of the word n-gram is made indispensable. Also in natural language processing other than speech recognition, in order to choose the word sequence 
which will seemingly be reasonable out of two or more word sequences, the word n-gram is used. However, in a word n-gram model, when the case of 
n= 3 (the chain model of three words: trigram model) is taken for an example, for example and the number of words is 20,000 words. It is necessary to 
consider the combination of the cube (8,000,000,000,000) individual of 20,000, and a huge memory is needed in the case of processing, and also there is 
a problem that that statistics value cannot be presumed, from an available language database (this problem is called the spar SUNESU problem). As for 
this problem, n becomes much more remarkable, when larger than 3. Such a problem had had big influence on the processing result in speech 
recognition. 

[0005]Then, the purpose of this invention is to provide the possible language processor and method of raising the accuracy of the chain probability 
between words, and easing the restriction about the memory of a language processor rather than classifying a word for every part of speech. 
[0006] 

[Means for Solving the Problem]In order to attain such a purpose, this invention an invention of claim 1, One class classifies two or more words into 
two or more classes which comprise a set of two or more words, chain probability which shows a grade of a chain between the classified classes 
concerned is acquired, and a language processor which chooses a class and/or a word sequence based on the acquired chain probability concerned is 
characterized by comprising the following: 

A memory measure which memorizes a classification of a thesaurus. 

A sorting means which classifies said two or more words according to a classification of this thesaurus. 

[0007]In the language processor according to claim 1 , said sorting means changes a word into a classification code, and an invention of claim 2 
calculates said word sequence with a gestalt of a classification code sequence at the time of calculation of said chain probability, when classifying said 
two or more words. 

[0008]An invention of claim 3 makes this attached word itself a classification code in the language processor according to claim 2 about an attached 
word to which said sorting means is attached to said word. 

[0009]As for an invention of claim 4, in the case of an independent word for which said word is not indicated to a classification of said thesaurus, in the 
language processor according to claim 2, said sorting means classifies every part of speech. 

[0010]An invention of claim 5 was further provided with a selecting means chosen as a meaningless sentence which uses a word sequence from which 
said chain probability serves as the minimum in an acoustic-sense experiment in the language processor according to claim 1. 

[0011]An invention of claim 6 was further provided with a selecting means which chooses a word sequence from which said chain probability serves as 
the maximum as an optimal candidate in voice recognition candidates in the language processor according to claim 1 . 

[0012]An invention of claim 7 relates to calculation of chain probability between each word in the language processor according to claim 1, When 
appearing probability of a word in a class and chain probability between classes are acquired and chain probability between words does not acquire 
directly, chain probability between said words is presumed based on appearing probability of said word, and chain probability between said classes. 
[0013]One class an invention of claim 8 in two or more classes which comprise a set of two or more words. In a language processing method which 
classifies two or more words, acquires chain probability which shows a grade of a chain between the classified classes concerned, and chooses a class 
and/or a word sequence based on the acquired chain probability concerned, A classification of a thesaurus is memorized and said two or more words 
are classified according to a classification of this thesaurus. 

[0014]In the language processing method according to claim 8, when classifying said two or more words, an invention of claim 9 changes a word into a 
classification code, and calculates said word sequence with a gestalt of a classification code sequence at the time of calculation of said chain 
probability. 

[0015]An invention of claim 10 makes this attached word itself a classification code about an attached word attached to said word in the language 
processing method according to claim 9. 
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[0016]ln the case of an independent word with which said word is not indicated to a classification of said thesaurus, an invention of claim 1 1 classifies 
every part of speech in the language processing method according to claim 9. 

[0017]In the language processing method according to claim 8, said chain probability chooses an invention of claim 12 as a meaningless sentence which 
uses a word sequence used as the minimum in an acoustic-sense experiment. 

[0018]An invention of claim 13 chooses a word sequence from which said chain probability serves as the maximum as an optimal candidate in voice 
recognition candidates in the language processing method according to claim 8. 

[0019]An invention of claim 14 relates to calculation of chain probability between each word in the language processing method according to claim 8, 
When appearing probability of a word in a class and chain probability between classes are acquired and chain probability between words does not 
acquire directly, chain probability between said words is presumed based on appearing probability of said word, and chain probability between said 
classes. 
[0020] 

[Embodiment of the Invention]Hereafter f with reference to drawings, the embodiment of this invention is described in detail. 

[0021]First, the language processing method which applied this invention is described. According to this embodiment, the class n-gram model based on 
a thesaurus is used. A word n-gram model is a model which approximates occurrence of a word sequence in n-1-fold Markov course. Therefore, word 
sequence w-|W2 — It is a formula about the probability that word w m will occur when w m _-| is given. [0022] 
[Equation 1] 

P ( Wm | W i Wz Wm- I ) 

»P ( Wm | Wm-n + l Wm-n + 2 '"Win-I ) 

[0023]It comes out and approximates (however, m>=n). Now, each word shall belong only to one class, respectively. The class to which word w; belongs 
is expressed with Cj. At this time, it is word sequence w^W2 with a class n-gram model. — The probability that word w m will occur under the conditions 
that w m _-| was given is approximated with a following formula. : [0024] 
[Equation 2] 

P ( Wm I W l W 2 Wm- 1 ) 



W (P (Cm | Cm-n + i Cm-n + z C m- I ) • P (w m | Cm ) 

[0025]Formufa which simplified several 2 formulas in the examination sentence generation for an acoustic-sense mental experiment : [0026] 

[Equation 3]P (c m |c m c m -i> 

[^ 

[0027]A word is classified into a class according to a class n-gram mode!, the probability (chain probability) which shows the grade of the chain 
between classes, and the appearing probability of the word in a class are used, and it is possible to reduce a number of parameters substantially 
compared with a word n-gram model. For example, when the number of V and classes is set to C for the size (the number of words) of the vocabulary 
to treat, the number of the independent parameters in the word n-gram is V n -1. On the other hand, the number of the independent parameters of a 
class n-gram model serves as C n ~1+V-C. The number of the independent parameters at the time of being referred to as V= 20,000 and C= 1,000 is 
shown in Table 1 . 
[0028] 

[Table 1] 

ID=000005 



[0029]Although the method of setting up a word class as a class n-gram model based on a part of speech from the former, etc. were proposed, there 
was a problem that only a rough word classification could be performed. Although the method of classifying a word using the mutual information 
between words is also proposed, the problem of the algorithm which searches for the optimal classification not existing is known. The thesaurus is 
known as a technique for on the other hand performing the semantic classification of a word. So, in an embodiment, solution of problems in a word n- 
gram model, such as a spar SUNESU problem, is aimed at by using the class n-gram model based on this thesaurus. 

[0030]For this reason, the example which made the meaningless sentence of listening comprehension checking for ** acoustic-sense mental 
experiment generate (a 1 st embodiment) 

** The example of management to the spar SUNESU problem in the word n-gram model for speech recognition (a 2nd embodiment) 

The case of two ** is illustrated. The case (trigram (chain probability of a triad)) where n of n-gram is set to 3 in any case is shown. 

[0031]1st and 2nd embodiments show the example using the classification lexical table of the National Japanese Language Research Institute as a 

thesaurus. In the classification lexical table, five digits divided by the period, such as 1.3062, are given as a code number of each word. Since the 

number of classes will become large too much if this code number is made into the number which expresses one class as it is, after omitting the last 

single figure, by this embodiment, a set of the word which has the same code number is treated as one class. 

[0032]In a classification lexical table, since only the independent word is registered fundamentally, when using the class model of several 2 formulas, the 
handling of an attached word poses a problem. How the word which is not registered into a classification lexical table is treated poses a problem. About 
the attached word, although it was also possible to have constituted a class by classifying grammatically, by 1st and 2nd embodiments, the method of 
making one class constituting from one word was adopted. About the word which is not registered into a classification lexical table, the method of 
registering automatically based on a morphological-analysis result was adopted at the time of class model learning. 

[0033]Study of the word n-gram usually presumes the probability value of several 1 formula from the frequency of a word chain, after dividing the 

sentence in a language database per word by a morphological analysis. Class n-gram and study are performed in the same procedure. 

[0034]First, a word is changed into a class code by dividing a language database per word and comparing with a classification lexical table. In that case, 
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an attached word does not perform conversion in a code, but makes the word itself a class code. The following processings are performed about the 
independent word which is not indicated in a classification lexical table. First, about conjugated forms, such as a verb, after comparing by a stem of a 
word, the conjugated form and a corresponding classification code number are added to the word-class conversion table prepared independently. A 
numeral also adds the numeral to a word-class conversion table, after assigning the code of a numeral compulsorily. About a noun, according to a 
morphological-analysis result, it distributes to the class of a "common noun", a "SA strange noun", a "proper noun", a "formal noun", an "adverbial 
noun", and a "tense noun", it doubles with it, and the addition to a word-class conversion table (table showing the correspondence relation of the word 
contained in a class and its class) is performed. It classifies into a strange class about the other word. 

[0035]The news manuscript database of the broadcasting station was used for study of the word trigram and the class trigram. This puts in a database 
the news manuscript which the journalist of the broadcasting station drew up from 1992 to May, 1996. In study of the class trigram, the size of the 
vocabulary was made into 20,000 words and the other word was assigned to the class only for an unknown word. The class only for this unknown word 
differs from a strange class (although the former is a class of the word which is not contained in a vocabulary and the latter is a word contained in the 
range of a vocabulary, the class which belongs is a set of a strange word). The number of the obtained classes is 936 and 518 of them classes were 
created from the classification lexical table. The number of average words assigned to each class to an independent word was 41. On the other hand, it 
creates on conditions with the same said of the word trigram. 

[0036](A 1st embodiment) Example ** is explained in detail hereafter. When doing an audio listening comprehension examination, in order to investigate 
how [ that was caught certainly ] it is, the incomprehensible sentence which consists of a plain word is created, and it is possible to experiment using 
the sound which read out this sentence. Hereafter, it illustrates about generation of such a meaningless sentence. 

[0037]The short owner meaning sentence prepared beforehand is divided into three portions, respectively, and creation of a meaningless sentence is 
performed by replacing these portions. The example of an owner meaning sentence is shown below. 

[0038]By a motorcycle A cigarette. It does not set. From this morning A gear tooth. It is painful. In a drawer It is locked. On the head A pigeon. It 
stopped. It is high. A building. It is in large numbers. 

[0039]However, after changing each sentence into a class code sequence using a classification lexical table and a word-class conversion table for 
facilitation, a meaningless sentence is created, when the occurrence probability for every sentence is calculated and probability chooses most the 
group of the sentence which became low only using the trigram probability between the classes of several 3 formulas. In order for comparison to show 
the effect of this invention, same processing was performed using the word trigram. Below, a result is displayed instead of a probability value for 
convenience using Perplexity. Perplexit(ies) in this case are P (w-j — w n ) and its entropy about the occurrence probability of each sentence (word 
sequence w-j — it expresses with w n ). [0040] 
[Equation 4] 

H (L) - - 2 — P (Wi ••• Wn ) lOg P ( W i — Wn ) 

n 



n 



[0041]When it carries out, [0042] 

[Equation 5]It is the quantity expressed with pp=2 H (D . Therefore, Perplexity becomes large, so that the occurrence probability of a sentence is small. 
[0043]The functional constitution of the language processor which performs language processing for the meaningless sentence generation of listening 
comprehension checking with such a language processing method is shown. In drawing 1, 1 is a processing block which generates a meaningless 
sentence by dividing into three portions the group (5 of the owner meaning sentences shown previously) of an input sentence, respectively, and 
replacing these. In this case, the number of the sentences generated is 14,400. 

[0044]2 is a morphological-analysis block which divides the group of the generated meaningless sentence per word. 4 is a storing block which stores a 
thesaurus. 6 is a word classification block which changes a word into a class code based on a thesaurus. 

[0045]8 is a storing block which memorizes a table of trigram probability (probability value of several 3 formulas) between classes. 10 is a processing 
block which calculates Perplexity based on a class trigram about a group of all the generated meaningless sentences and as which Perplexity chooses 
most a group of a meaningless sentence which became large. 

[0Q46] Drawing 2 shows the contents of language processing performed in a language processor. Actual language processing is explained according to 
drawing 2 . The contents of execution in each block of drawing 2 are as follows. 
[0047]B-2: A block which reads a group of an input sentence. 

[0048]B4: A block which generates a meaningless sentence by dividing each input sentence into three portions, fixing the 1st portion, and replacing the 
2nd and 3rd portion. Five sentences, [0049] 
[Equation 6] 

. Express with b^ Ibi2bi3b2ib22b23b3^b32b33b4^b42b43b5ib52b53. (by is the j-th block of the i— th sentence). The function r shall be fulfilled for i!=j=>r(i)! 
=r(j) by the function from a set {1, 2, 3, 4, 5} to {1, 2, 3, 4, 5}. The function s is defined similarly. At this time, it is by this block, [0050] 
[Equation 7] 



[0051]lt comes out and the sentence expressed is generated, rj and sj are the brief sketches of r(i) and s(i) here, respectively. 
[0052]B6: The block which substitutes zero for the variable Max. 

[0053]B8: The block which judges whether the group of all the meaningless sentences generated by B4 was chosen. 

[0054]B10: The block which chooses the group which has not been chosen yet from the groups of the meaningless sentence generated by B4. 
[0055]B12: A subroutine which calculates the Perplexity to a group of a meaningless sentence selected by B10. For details, it is shown in drawing 3 . An 
input is a group of a meaningless sentence and a calculation result is returned to the variable out. 
[0056]B14: A block with which a value of the variable out judges that it is larger than the variable Max. 
[0057]B16: A block with which a value of the variable out judges that it is equal to the variable Max. 

[0058]B18: A block which stores a group of a meaningless sentence which initializes an array which stores a group of an output statement and is 
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chosen there now. 

[0059]B20: A block which replaces a value of the variable Max with a value of the variable out. 

[0060]B22: A block which adds a group of a meaningless sentence chosen as arrangement which stores a group of an output statement now. 
[0061 ]B24: A block which outputs a group of an output statement stored. 

[0062] Drawing 3 shows the contents of processing in a subroutine shown in B12 of drawing 2 . A processing block of drawing 3 is constituted by the 
following blocks. 

[0063]B32: Brock who substitutes zero for the variable out. 

[0064]B34: Brock who judges that all the sentences were chosen when choosing a sentence from a group of an inputted meaningless sentence. 
[0065]B36: Brock who chooses a sentence which has not been chosen yet from groups of an inputted sentence. 

[0066]B37: Morphological-analysis Brock who divides a selected sentence per word. As a morphological-analysis method, although what kind of method 
could be used, by this embodiment, the software Juman developed in Kyoto University was adopted. 

[0067] B38: Brock who decomposes a sentence into 3 groups of a word. When a sentence is made of connection of word w-j, W2, — w n , 3 group W1W2W3 
and W2W3W4, — , w n _2W n _iw n are generated. 

[0068]B40: Brock who classifies each word in a three word group into a class, and changes into three groups of a class code. Group W1W2W3 of three 

words, W2W3W4, — , w n -2W n _iw n , It changes into three class group 0^0203 and C2C3C4, — , c n _2C n _ic n . 

[0069]B41: A block which reads trigram probability of several 3 formulas about three each group generated by B40. 

[0070]B42: From trigram probability read by B40 to a formula [0071] 

[Equation 8] 



[0072]The block which calculates Perplexity of a sentence as be alike. 

[0073]B44: The block which substitutes for the variable out the sum of the value of the variable out, and the value of Perplexity calculated by B42. 
[0074]B46: The block which outputs the value of the variable out. 

[0075](A 2nd embodiment) Example ** is explained in detail below. Since 3 groups of the word contained in the uttered sentence generally did not exist 
at the time of study when using a word trigram model by speech recognition, the probability value may not be able to be presumed. In example **, the 
probability value is presumed to such a case using the class trigram of several 2 formulas. 

[0076] Drawing 4 shows the functional constitution of the language processor which performs language processing of example **. In this example, there 
is a certain connected speech recognition system, and the case where this system outputs two or more recognition candidate sentences is assumed. In 
drawing 4 , the morphological-analysis block which divides two or more sentences into which 22 was inputted as voice recognition candidates per word, 
and 24 are storing blocks which memorize word trigram probability (several 1 formula). 26 is a processing block which reads the word chain probability 
corresponding to an input. The storing block for which 28 stores a thesaurus, and 30 are word classification blocks which change a word into a class 
code based on a thesaurus. 

[0077]32 is a storing block which memorizes a table of trigram probability between classes, and class word probability (probability that a word will 
appear in the class). 34 is a processing block which calculates class trigram probability (probability of several 2 formulas) corresponding to an input 
sentence. 36 is a processing block which calculates Perplexity to an inputted sentence (recognition candidate) and to which the value chooses and 
outputs the smallest thing (what has a high probability value), using class trigram probability, when word trigram probability is not called for. 
[0078] Drawing 5 shows the contents of language processing in Example 2. Actual language processing is explained according to drawing 5 . The contents 
of execution in each block of drawing 5 are as follows. 

[0079]B-52: A block which reads a group (two or more recognition candidates) of an input sentence. 
[0080]B54: A block which assigns the smallest possible value to a value of the variable Min. 
[0081 ]B56: A block which judges whether all inputted sentences were chosen. 
[0082]B58: A block which chooses a sentence which is not chosen by then. 

[0083]B60: A subroutine which calculates Perplexity to a selected sentence. An input is the selected sentence and returns Perplexity to it using the 
variable out. 

[0084]B62: A block with which the variable out judges whether it is smaller than the variable Min. 

[0085]B64: Initialize an array which stores an output statement and store a sentence chosen as the arrangement now. 
[0086]B66: Assign a value of the variable out to the variable Min. 
[0087]B68: Output a sentence stored in arrangement for output statements. 

[0088] Drawing 6 shows the contents of processing of the subroutine B60. A processing block of drawing 6 comprises the following blocks. 
[0089]B72: A block which substitutes zero for the variable out. 

[0090]B73: A morphological-analysis block which divides an inputted sentence per word. 

[0091 ]B74: A block which decomposes a sentence into 3 groups of a word. Sentences are word w-| and W2- — When made of connection of w n , 3 group 

w-| W2W3 of a word, W2W3W4, — , w n _2W n --|W n are generated. 

[0092]B76: A block which judges whether 3 groups of all word were chosen. 

[0093]B78: A block which chooses a three word group which is not chosen by then. 

[0094]B80: A block which judges whether a word trigram exists to selected 3 groups. 

[0095]B82: A block which adds an opposite numerical value of probability called for from a word trigram model to the variable out. 
[0096]B84: A word classification block which asks for 3 groups of a class from 3 groups of a word chosen. 

[0097]B86 : When making into Cj a word class to which w m _ 2 w m _-|W m and word Wj belong 3 groups of a word, Chain probability over 3 group c m _ 2 c m _ 
ic m of a class, A block which calculates an opposite numerical value which is the chain probability which is 3 group w m -2W m -i w m of a word from 
appearing probability of word w m under conditions to which c m was given according to several 2 formulas. 
[0098]B88: A block which adds a probability value calculated by B86 to the variable out. 
[0099]B90: A block which outputs the variable out. 

[0100]In this embodiment, when creating a word class, the single figure of the last of a code number of a classification lexical table was omitted and 
created, and an attached word was made into 1 word 1 class, but it is applicable also to a method of creating a word class by other methods. Although 
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a classification lexical table of a ward-facilities language research institute was used as a thesaurus, it cannot be overemphasized that it can apply 
when thesauri other than a classification lexical table are used. Only in in n= 3 (trigram) of a n-gram model, it illustrated, but of course, it can apply also 
to a value of other n. 

[0101]An experimental result about example ** which generates a meaningless sentence using five sentences mentioned above is shown below. The 
result with which Perplexity compared a group of a generated meaningless sentence to descending (namely, order with small occurrence probability) is 
as follows :P By erplexity:260.36 motorcycle A cigarette. It has started. From this morning A building. It does not set. In a drawer A pigeon. It is in large 
numbers. On the head A key. It is painful. It is high. A gear tooth. It stopped. 

[01 02] Perplexity: By 260.36 motorcycles A cigarette. It stopped. From this morning A building. It does not set. In a drawer A pigeon. It is in large 
numbers. On the head A key. It is painful. It is high. A gear tooth. It has started. 

[0103]Perplexity: By 260.27 motorcycles A cigarette. It has started. A building from this morning. It is painful. In a drawer A pigeon. It is in large 
numbers. On the head A key. It does not set. It is high. A gear tooth. It stopped. 

[01 04] Perplexity: By 260.27 motorcycles A cigarette. It stopped. From this morning A building is painful. In a drawer A pigeon. It is in large numbers. On 
the head A key. It does not set. It is high. A gear tooth. It has started. 

[01 05] Perplexity: By 258.92 motorcycles A pigeon. It is in large numbers. From this morning A building. It does not set. In a drawer A cigarette. It has 
started. On the head A key. It is painful. It is high. A gear tooth. It stopped. 

[01 06] Perplexity: By 258.92 motorcycles A pigeon. It is in large numbers. From this morning A building. It does not set. In a drawer A cigarette. It 
stopped. On the head A key. It is painful. It is high. A gear tooth. It has started. 

[0107]Perplexity: By 258.83 motorcycles A pigeon. It is in large numbers. From this morning A building. It is painful. In a drawer A cigarette. It has 
started. On the head A key. It does not set. It is high. A gear tooth. It stopped. 

[01 08] Perplexity: By 258.83 motorcycles A pigeon. It is in large numbers. From this morning A building. It is painful. In a drawer A cigarette. It stopped. 
On the head A key does not set. It is high. A gear tooth. It has started. 

[0109]On the other hand, a block of drawing 3 of B40 performed same processing using a word trigram (several 1 formula) for comparison. As a result, 
16 sets of groups of a sentence (a probability value became the minimum) from which Perplexity became the maximum were obtained. These parts are 
shown below :P By erplexity:7 18.67 motorcycle A cigarette. It does not set. From this morning A gear tooth. It is painful. In a drawer A pigeon. It 
stopped. On the head A building. It has started. It is high. A key. It is in large numbers. 

[0 110] Perplexity: By 718.67 motorcycles A cigarette. It does not set. From this morning A gear tooth has started. In a drawer A pigeon. It stopped. On 
the head A building. It is painful. It is high. A key. It is in large numbers. 

[01 11]Perplexity: By 718.67 motorcycles A cigarette. It does not set. From this morning A gear tooth has started. In a drawer A pigeon. It stopped. On 
the head A building. It is in large numbers. It is high. A key. It is painful. 

[01 1 2] Perplexity: By 718.67 motorcycles A cigarette. It does not set. From this morning There are many gear teeth. In a drawer A pigeon. It stopped. On 
the head A building. It has started. It is high. A key. It is painful. 

[01 13]perplexity: By 718.67 motorcycles A cigarette. It stopped. From this morning A gear tooth has started. In a drawer A pigeon. It does not set. On 
the head A building. It is painful. It is high. A key. It is in large numbers. 

[01 14] Perplexity: By 718.67 motorcycles A cigarette. It stopped. From this morning A gear tooth has started. In a drawer A pigeon. It does not set. On 
the head A building. It is in large numbers. It is high. A key. It is painful. 

[01 15] Perplexity: By 718.67 motorcycles A cigarette. It stopped. From this morning There are many gear teeth. In a drawer A pigeon. It does not set. On 
the head A building. It has started. It is high. A key. It is painful. 

[0116]When these experimental results were compared and a language processing method of this embodiment was used, by a case where a word 
trigram is used, a result that an owner meaning sentence of a basis was also contained was brought to being stabilized and constituting a meaningless 
sentence. This shows that this invention has sufficient effect. 

[01 17]Next, in order to investigate an effect of example **, a case where back-off smoothing was used was compared with this invention by calculating 
Perplexity using a beginning sentence of actually broadcast news. Used data for evaluation is the text which it began was written with generating of an 
anchor in an existing news program on June 4, 1 996, and a sentence which overlapped with a database for study is not contained. That Perplexity at 
the time of using back-off smoothing was [ for ] 62.38, when a language processing method of this embodiment was used, the result 57.97 was obtained, 
and the result checked an effect of this invention. 

[01 18]In this experiment, first, a class trigram model was adopted as a word trigram model and a class n-gram model as a word n-gram model, and 
perplexity compared only these both. Back-off smoothing of Katz was used together about a word trigram. A result is shown in Table 2. The word 
trigram showed perplexity lower than a class trigram from Table 2. 
[0119] 
[Table 2] 



[0120]ln order to investigate this reason, a result which receives data for evaluation was examined in detail. As an example which has lowered 
perplexity of a word trigram model, a trigram shows an example used as a high value. 
[0121] 
[Equation 9] 

P(the exercise | Pacific rim — congruent) =1P(center [ of council | ], education)=1 — in the example of these, the probability of the trigram is 1. That 
is, in learned data, when the chain of two say words appears [ the "Pacific rim" and / "" ], in the next, it means that the "exercise" always appeared. A 
"center", "education", and a "council" are the same. It seems that the value of word perplexity fell since the chain of such three words appeared also 
in the data for evaluation. 

[01 22]On the other hand, since each will be transposed to a class even if there is only "exercise" in learned data as a word which follows [ the "Pacific 
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rim" and / "" ] in the case of a class trigram model, probability of a class chain is not necessarily set to 1. Since appearing probability of an "exercise" 
in a class (1.305) which belongs can multiply probability of this class chain by an "exercise", a probability value of a class trigram model becomes still 
smaller. Perplexity of a class trigram model is considered to have become larger than a case where a word trigram model is used by such reason. 
[01 23] Conformity capability as opposed to learned data in a direction of :(1) word trigram model in which the following conclusions are obtained from 
the above examination is higher than a class trigram model. Therefore, when a statistical property of data for evaluation and data for study is alike, high 
expression ability is demonstrated. 

[0124](2) A class trigram model has the same effect as smoothing in order to use a statistical property for every class. Therefore, although it cannot 
expect that a probability value is set to 1 like several 9 formulas, it is possible to presume the probability value also to a word chain which does not 
exist in learned data. 

[0125]From the above (2), how to use a class trigram as a smoothing model for a word trigram can be considered. So, when 3 groups of a word which is 
not contained in a word trigram model appeared, not using back-off smoothing, a multiplicative model which presumes a probability value with a class 
trigram model was built, and it asked for perplexity to evaluation data using this model. As a result, to perplexity 62.38 in word trigram + back-off 
smoothing, the result 57.97 was obtained and it became possible to decrease perplexity further. 
[0126] 

[Effect of the Invention]As mentioned above, as explained, since a word is semantically classified according to a thesaurus, compared with the 
classification of a part of speech, also in the word according to which there were many kinds of a classification and it was classified, a degree of 
association becomes deep and the accuracy of chain probability becomes high as ** by the invention of claims 1 and 8. 

[0127]Since the word itself is not used but the classification code of a classification with which the word is contained is used in the invention of claims 
2 and 9 when acquiring the chain probability between words, For example, the number of combination of the classification code which memorizes the 
chain probability of the learned classification code decreases substantially compared with the combination of a word. Thereby, memory space of a 
language processor can be made smaller than before. 

[0128]In the invention of claims 3 and 10, it is making ** of attached **** into a classification code about the attached word which is not indicated to a 
thesaurus, and handling becomes possible also about an attached word. 

[01 29]It is classifying a part of speech according to the invention of claims 4 and 1 1 about the independent word which is not indicated to the 
classification of the thesaurus, and the handling of many words becomes possible. 

[0130]In the invention of claims 5 and 12, the meaningless sentence used in an acoustic-sense mental experiment can be created because chain 
probability chooses the word sequence used as the minimum, and the created sentence does not include an arbitrary element, either. 
[0131]Since chain probability makes the word sequence used as the maximum the optimal candidate in voice recognition candidates in the invention of 
claims 6 and 13, compared with the speech recognition of only the conventional word, the chain between words is taken into consideration and speech 
recognition precision improves. 

[0132]In the invention of claims 7 and 14, since the chain probability between words can be presumed even when the chain probability between words is 
not given by study etc., the word which is the target of handling can be made into a large number. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 
[Drawing 1] It is a block diagram showing the functional constitution of the language processor of a 1 st embodiment of this invention. 
[Drawing 2] It is a flow chart which shows the procedure of the language processor of a 1st embodiment of this invention. 
[Drawing 3] It is a flow chart which shows the procedure of the language processor of a 1st embodiment of this invention. 
[Drawing 4] It is a block diagram showing the functional constitution of the language processor of a 2nd embodiment of this invention. 
[Drawing 5] It is a flow chart which shows the procedure of the language processor of a 2nd embodiment of this invention. 
[Drawing 6] It is a flow chart which shows the procedure of the language processor of a 2nd embodiment of this invention. 
[Description of Notations] 

1 Meaningless sentence generation block 

2 Morphological-analysis block 
4 Thesaurus table storing block 
6 Word classification block 

8 The processing block which stores the table of the trigram probability between classes 

10 The processing block which chooses the group of a meaningless sentence 

22 Morphological-analysis block 

24 Word trigram probability storing block 

26 The processing block which reads word chain probability 

28 Thesaurus storing block 

30 Word classification block 

32 The storing block which memorizes the table of the trigram probability between classes, and class word probability 
34 The processing block which calculates a class trigram 

36 The processing block which chooses a recognition candidate using class trigram probability 
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& D loft £&$ti?t£x<DmMmj:<Dmc-o\<>x2 

Perplexity**** < ^ ^/c*Mtt*CDffi^3iJR-r €>®I 

t/P '>^*C*^o 

[0 04 6 ] B2«»^«iffl^g^*5i>r^f*r-s#s 
its. m2<D&uv2i t ctetf&mtfftmzMT<D± 

[ 0 0 4 7 J B 2 : A*X<Difi*W#i&t*:7p * ^ D 10 
[ 0 0 4 8 ] B 4 : SA^X* 3 o<D§fc&K:#S9 U * 

4, 

[0 04 9] 

[KB] 
bn b 12 b 13 
b 21 b 22 b 23 
b 3a b 32 b 33 

b 41 b 42 b 43 20 
b si b S2 b S3 

/c, 2, 3, 4, 5} *6 {1. 

2 , 3 , 4 , 5 } ^C0mmx\ i * j => r ( i ) ^ r 
(j) Sftfc-rfeOi-rS. Sfc, MRs6ig«C3£« 

^r^ e coif, 

[0 0 5 0 ] 

b ll b n2 b s,3 

30 

b 21 b r 2 2 b s*3 
b 31 b r*2 b s 8 3 
b 41 b r.2 b s.3 
b 51 b r 5 2 b s 5 3 

[0 05 1]T»SnSX4fi3cT5 D CCSC, r f , 

Si -eti-en, r ( i ) , s ( i ) <Dmmxfo& 0 40 

[0 0 5 2 ] B6 : SE»Max5CO*R\-r*^P5r 
[ 0 0 5 3 ] B 8 : B 4r^S$n/c^rcD»Jgq*3t© 
[0054] B10 :B4 r^/jKSftfcftmfcfcOfflGr) 
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[0 05 5] B12 ; B10 TJHRS titcmMm^COm 
^Lt, *<DPerplex1ty*ttfitTStf^-^> 0 1$ 

tt, ftou ttcigSti& B 

[0 0 5 6] B 1 4 : 3QK o u t CDffi^ fSMax<£ 
[0057] B16 :Siout ©ffl#s* SHSMax £ 
[ 0 0 5 8 ] B 1 8 : ffl*X©«I*«WW- SB^J*S0« 

[0 0 5 9] B2 0 : »Ma xCDfii*. SSSoutO 

[0060] B22 : «EW«:, M 

[0 06 1 ] B2 4 :«»3hr^*Hl^7S:oa«Hl* 
^S:/p * ^ 0 

[0 0 6 2] BI3», IM2CDB 1 2(C^L/c1f^ 

>\s-*yx<D&m?m%:7rc? 0 03(?)M^P'^K« 

[0063] B32 :^ou t CC0 *«AT4^n ^ 

[ 0 0 6 4 ] B 3 4 : A* 3nyfc*«lftfi:<D«*» 6 , 3: 

[0 0 6 5] B3 6 : A*3ftfc#©fi©**>6, *K 
[0 0 6 6] B 3 7 : ^3ftfc;£*flitB#fito^^ 

[0 0 6 7] B 3 8 : X**H03o»^jBT S^P 

x^fiw, , w 2 , •••w B ©aaarc , cfirrif>s 

®n\ 3oiw! w 2 w 3 , w 2 w 3 w 4 s — , w„_ 2 

[0 0 6 8 ] B4 0 : *H3offlEfKD^*R*^^X5C. 
#S(U ^7X3- K <D 3 ^©fifc^^S 
^ISSoofflWi w 2 w 3 , w 2 w 3 w 4 , w„_ 2 
w n _ t w n £ v ^7X3^! c 2 c 3 , c 2 c 3 c 
4 , c n „ 2 c n _ a c„ frC^-r&o 

[0 0 6 9] B4 1 : B 4 0 r^3tifcS3ofiCCo 

[0070] B42 : B40 xnfrtii Uch^^ ^ A 

[0 0 7 1 ] 
[JR8] 
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n 



pp = 2 H(L) 

[0 0 7 2 ] ^CioTS:<Z)Perplexity?:lt#TS^n v 
>?« 

[0073] B44 :Siout^ ftout^fli 
B 4 2 T?^*6fcPerplexity(D^^ 

[0074] B46 :fSout :/n * 

[0 0 7 5 ] (&2 9gN0£iK) #&C#(©teot>T, «T 

[0076] a 4 \zm<2><Dwmm&*m^&mm%m 
So 26B, AMzts^zmmmmmzmfrmrm 

[0 0 7 7] 3 2l^7Xn©h7^^7Ai$ 

*> ©^ifBflfrSttJft^n^^^fta. 3 4B, A* 

JC»-T £ Perpl exi tyfcStflt L , «0tt#tft fc/hS ^ -> ft: 

[0 0 7 9 ] B 5 2 : A*]£©ffi (^(DBtttigfii) * 
[0 0 8 0 ] B 5 4 : S»M i n CDffi^C, nlWtfrif*) 



[ 0 0 8 1 ] B 5 6 : A#3ftfc:£*£T»|R3Jhfc;fe 

io £5*ft«®rs^p ? ^ Q 

[ o o 8 2 ] b 5 8 : *ft*rK»3hrc»fci>s:* 

[0 083] B 6 0 : jWlSftfcXfcaWS Perplexity 
0, ^tlfc^TS Perplexity*^ o u t £jm>Tjg 

To 

[0084] B62 :Siout^ ftM i n <£ 5 /h 
[ 0 0 8 5 ] B 6 4 : ffi^XttMfiT SE?tt*fiBHft 

20 u *©e*ik:, *isw3nr^4S:*«wrrs. 

[0086] B66 : ^**M i n SClEtfc o u t <Dffi£ft 
A-TSo 

[0 08 7] B68 : mjjJcm<Dm&ltCfflh$tiX\,*Z 
[0 0 8 8] H6tt; ^;H^>B6 0<D«fi§4 

[0089] B72 :■ »R o u t 0 Sf^AT* 7^ ? 
30 [0 0 9 0IB73: A^Sn/cX^^IS^^C^WT 
[ 0 0 9 1 ] B 7 4 : X*^iS<D3offltC^»T4^n 
a^, #f^CD 3 offlw a w 2 w 3 , w 2 w 3 w 4 , — , w 

n- 2 W n _ a W n ^rii^*rSo 

[0 0 9 2] B 7 6 : £T©*B©3 offi#«K3ftft: 

[0 0 9 3 ] B 7 8 : *ft4rfc«?3*iT l^JTC^g 
3^ffl*SiRiT£:/n^ 0 
40 [0094] B80 : S{R3ftft:3offlfc:>tfU 
^ >f ^7A^ffST 5 *> £ 5 * S 7 a 9 ^ 0 
[0 0 9 5 ] B 8 2 : ^ A^;l/:fa6jj<tf> 

[0 0 9 6 ] B 8 4 : ®JR3ftTl>£#fl<D30jja3&:> 
[0 0 9 7] B 8 6 : m$<D3 ^ffl£w n _ 2 w,., w 

■ , mmw, oflrrsmgi *^**c, t> 
^xco3offic m „ 2 c... c itMT&mmmt, c 

50 „ #^*6ftfc^Tr<D|iBw B CDHJ3K»*^6, & 
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[0 0 9 8] B88 :B8 6t«lfi^^|o u 
[0099] B90 : ^»ou t*ffl*t4^9^ B 

[oioo] #w****ffiB«-s 

ffrSU SfcttJRlftt 14*111 ^7Xilfc3&s, ^©flfc 

^:»^5cafflRllfea:Ci»l^*r fettle Sfc, n- 
g r am^^KDn = 3CD£g^ < r^-T^^A) <D*§-£ 

[0101] J^L&5^©**fflCiT*«Wbt**J« 

W¥*/h£(,>J«) teffi^fc*SStt* JWT©iIDr*£ : 
Perplexity: 2 6 0.3 6 20 

-r^&i^ 5i#mu^ «§* /c<£a,#>s 0 §i 

*C flt* *l>o i*l> ft* ±o/c e 
[0102] Perplexity : 2 6 0 . 3 6 

^h^Vta flES* i^/to 4»6 tvu* 

* Jftl^c i*l> ft* **^t^5, 
[0103] Perplexity : 2 6 0 . 2 7 

^h^VW »otl^ fl 4W*e> 

;i"* sisrffli-K: *§* fc< £A,&£ 0 gicc 30 

m# -r^L&^o j*i> ft* ±^/c 0 

[0104] Perplexity : 2 6 0 . 2 7 

a&afi ±-z>tc 0 ^m&h vMfi 

3ISWLK: *S* fc< S/*,**. Site Si* 
*r^.^c(,^ 0 Hfii ft* w^ri^o 

[0105] Perplexity : 2 5 8 . 9 2 
*-h'-Wr« *S* ft:<S^5 B 4W^ tf;l/ 

* -T^^^o 3ISttiUc Mf* W^tl^, SB 
CC $1* Jft> 0 i*l> ft* ih^fco 

[0106] Perplexity : 2 5 8 . 9 2 40 
t-h^Vttt ill* fc< ^MH*>6 

* ««?* ±^/c D 9RCC ft 

* J*l>„ j*t> ft* **oTlr>S 0 

[0107] Perplexity : 2 5 8. 8 3 

* 3l*mucc a¥* **orc^ 0 BRc 

a* r*&^o i*^ ** itofc 0 

[0108] Perplexity: 2 5 8.8 3 
t-F^Vrtt «§* fc< S^So 4IB*6 bf;l/ 

* ll^o 3l#HiLK: JEW* ifc^fc. ffl{c §1* 50 
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•r^^ci^ r©c> ft* *»*orti8. 

[0109] — iktSOfcS), SI 3 CD B 4 0 CD :/U ? 

*fgh^-r^A (tiS) |hi«cd^ 

a^tfofco -tCDfeS, Perplexity*^£&-ofc (ffi 
WWi/hii^k) 1 6fflf#en/c 0 «T 

scene©— gp^Tjrr : 

Perplexity: 7 18. 6 7 

t^h^vw ov* ^«*& ft* 

3l*ffibfc: *§* ±ofc 0 UK. tvi/* ** 

[0110] Perplexity: 718. 67 

lf# titSli, 4ffl*6 ft* 
**oTl>£ 0 3l#ttJUt Jft* ±ofc 0 BRSc hf;U 

* Jill). Hfe) a* fc<3A,&<£ 0 
[0111] Perplexity: 718, 67 

*-wwrB *r*&t>„ 4W*e» ft* 

* /c< i*i> it* *i> 0 

[0112] Perplexity : 718. 67 

TA&H. 4W*6 ft* 
fc<S/*,*S. 3ISIHLK: «* ±ofc 0 SI&c fcf 
;l/* **oTl>S 0 i*i> m& ffii^o 
[0113] perplexity : 7 1 8 . 67 

h^MTO ±ofc e 4*18*6 ft* * 

*^t^5„ sitrfflOK *i* si&c b^v 

* i*c> »* /c<3^^^ 0 

[0 114] Perplexity: 7 18. 6 7 
t-F^^i Sf* iofc, 4«*6 ft* * 

*oT^a 0 5i#mt>{c »* t*.&^o ncc tvu 

* /c< S^S 0 l*l^ gi* 

[0 115] Perplexity: 7 18. 6 7 
tf-h'<-ft?tt flE?* ±r?fc. ft* 

<3^fe'S 0 gisraoK: «* -r*ai^ ncc bvv 

* **^Tl>&o i*C^ n* *l^ 0 

[0 116] cn6©IOMS**JftK-r-5i, 

[0 117] acfc, «®0«SSrHI^4fc», HffiCCtt 
pl§nfc^^-XCD»^SaL5:^ffll^rPerplexity^ft 

«Wi«t8(.fco ffl^/cMffl^^^, 1 9 9 6¥ 

ffiit*mi<>tcm&<D Perplexity* 6 2.3 8 ~Cfo-D?t<D 
7. 9 7il^*fi»*»6ti. *«WC«(Hi*s«H3ii 
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[0118] tomm-Cte&r. mmn-g r am*<r 



[0 119] 
[^2] 







S ( i ) 0^x;t/ 


62.38 


s; (2) ©^t*^ 


186.16 


3; (3) w^tji* 


33. 76 



[0120] c<Dm&%m^&tctb. mmR}<D7*-$t f c 

A#^^lil£ & ^ fcW^To 
[0121] 
[tfc9] 

P («■ I Bbfc¥^ £HI) = 1 

p <«k# i aw> = i 

[0 12 2] cn^lT, ^Xh^^A^r^ 

x ( i . 305) cc*5w s rsigj <Dmmw&&mt*> 

[0123] HiOWJ: 0 > *©<t 9ttMAka»W6ti 
(1 ) ^ISh^^^^A^^KD^, ^7Xh7^f^ 



[0 12 4] (2) h7-/y7A*f;Hi, ^ 

20 «©aw**-rs, Sot, »9 3S©J:5CC»M3W1 

[0 1 2 5] _hlB (2) <fc0, ^7^h7^7A§# 

^t7XA->?>^fflOl ^7Xh7^y7A^& 

30 co^f^m^x, Mf-^sts^-^i/*'>f 

-f*5jcftfc 0 ^CDfeU, MBh^-f^A + J****:? 
¥»ft©t>^©^— ^U+^-f 6 2. 3 8^Lt, 

6 *C**I> $ * 5 C <h ifi *m t ft -a fc. 
[0 12 6] 

felt, tW»t,fcJ:5K:, W*S1, 8© 

[0127] fff*JB2 , 9 CWBSfHrtt, #11 IHOgflUB 

fie** f3 fe/hs < -r s cim^ 0 
[o i 2 8 ] i§5j<a3, i o<D»grctt, : s/v-^k: 

50 ^KitScir, ftJKSS5c^lirfe8(0®l^pIffi 
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[0129] fi*iS4, i lomi-ea, vv-wo 
[0130] it^5. i 2o^i§-c{j > mmmm®m: 

[0131] mspge . l 3©#^raaflBWfcWft* 
4 ft SWMft* WWMRttKDcfi ©*3WR*B i-T S© 10 

[0132] it*^7 , i Aomttu, ^wmicj: *) 

[0®©1S#&iftBj§] 

[01] i J|Jfe^©SMMa^g©li^^ 

[02] i mmmm<Dmmmmm.mi<Dmm^im 20 
[03] *mwm 1 mmmm<Dwmmmm<Dmw^m 
[04] *^hj^ 2 **fe»«g©#iiMa«g©«#e«^ * 
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[0 5] *^^2SIWJg|©l-fiMffi«g©telM^JlH 

[06] * ah 9 2 mmBM<Dnmmimm<Dmmmm 
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